Chancellor's Office 
California Community Colleges 



AB1417 Performance Framework for the 
California Commnnity Colleges 

A Report to the Legislature, pursuant to AB1417 



March, 2005 



California Community Colleges Chancellor’s Office 
www.cccco.edu 




AB1417 PERFORMANCE FRAMEWORK FOR 
CALIFORNIA COMMUNITY COLLEGES 



The following is a report to the Legislature and Governor that provides reeommendations 
on the design of a workable structure for the annual evaluation of district-level 
performance for California Community College districts. This report is being submitted 
by the California Community Colleges Board of Governors (BOG) pursuant to the 
requirements of AB1417 (Pacheco), [Chapter 581, Statutes of 2004], 

Questions regarding the report or its contents can be directed to Patrick Perry, Vice 
Chancellor of Technology, Research & Information Systems at the California 
Community Colleges Chancellor’s Office, pperrv@cccco.edu or 916-327-5912. 
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AB1417 Performance Framework for California 
Community College Districts 



Background 

AB1417 (Pacheco) [Chapter 581, Statutes of 2004] charged the Board of Governors “to 
provide recommendations, based on information to be developed in a study to be 
conducted by the Chancellor of the California Community Colleges, to the Legislature 
and the Governor regarding the design of a workable structure for the annual evaluation 
of district-level performance in meeting statewide educational outcome priorities The 
legislation further states that the reeommendations “shall be based on information and 
data provided by a study to be completed the Chancellor of the California Community 
Colleges, with the input of institutional representatives of community college districts. ” 



Process 

The State Chaneellor’s Office of the California Community Colleges contracted with the 
Research and Planning Group for California Community Colleges (RP Group) Center for 
Student Suecess (CSS), the RP Group’s researeh and evaluation organization, to carry out 
a study to develop a set of performance frameworks and performance indicators for 
discussion and review. Appendix A lists the members of the Research and Planning 
Group/Center for Student Suecess. 

The RP-CSS was also charged with the task of assembling an “External Panel of 
Experts”, as speeified in AB1417. The External Panel consisted of six members who 
have a great deal of community college accountability experience on a national level. The 
External Panel reviewed the draft framework twice and provided comment and guidance 
in the project, and has given the proposal high marks. Appendix B lists the members of 
the External Panel. This External Panel review satisfies AB1417’s requirement of 
consulting “with individuals with demonstrated expertise in higher education 
accountability and evaluation.'''’ 

The Chaneellor created an Oversight Committee to provide poliey perspective for the 
project. This consisted of five members from the Community Colleges Chief Executive 
Officers Board/Eeague and Community College Aeademic Senate. The Oversight 
Committee met on four oecasions between Deeember 2004 and Eebruary 2005, and was 
instrumental in refining the proposal into the form it is today, and has given its approval 
to the framework as meeting the requirements of AB1417. Appendix C lists the members 
of the Oversight Committee. 
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The Community Colleges Consultation Council has reviewed the proposal twice 
(meetings in January and February, 2005) and has also agreed that the proposal meets the 
requirements of AB1417. 

Community College groups and interested parties were given an opportunity to review 
and comment on the proposal; this occurred in late January-early February 2005. Vice 
Chancellor Patrick Perry made a total of seven field presentations during this time 
explaining the proposal and fielding input and questions. Much of the input was used to 
refine the final product that was taken to the Consultation Council in February. 

AB1417 also specified that the Department of Finance and the Legislative Analyst’s 
Office be consulted. This has occurred along the way, including two meetings in January 
and February with representatives of these entities. 

Finally, the proposal enclosed herein was approved by the Community Colleges Board of 
Governors (BOG) at its meeting on March 7, 2005. 



Operating Assumptions 

In developing the draft framework model and proposed reporting metrics, the RP-CSS 
and Chancellor’s Office (System Office) staff developed a number of operating 
assumptions that provided decision support for either inclusion or exclusion of model 
types or particular measurements. 

Proposed Criteria for California Performance Framework. AB 1417 calls for the design 
of a “workable structure” to evaluate district level performance. A “workable structure” 
for annual evaluations of district performance requires that such a framework: 

1 . Supports measures for accountability based upon both the state’s educational 
priorities as well as local district priorities'; 

2. Reflects the breadth and scope of the missions and functions of the California 
community colleges; 

3. Uses measures that will provide a fair and equitable view of a district’s 
performance including such factors as the educational needs of the service area 
population and size and capacity of the institution(s); 

4. Provides clear, straightforward performance information that can be understood 
by the general public; 

5. Relies upon available data that are accessible to district-level research offices 
and/or the State Chancellor’s Office. 

6. Enables Districts to pursue improvements. 



* State law delineates the mission and funetions of the CCC. Community eolleges are to offer aeademie 
and voeational edueation at the lower division level for both reeent high sehool graduates and those 
returning to sehool; to advanee California's eeonomie growth and global eompetitiveness through 
edueation, training, and serviees that eontribute to eontinuous workforee improvement. Essential and 
important funetions of the eolleges inelude: basie skills instruetion, providing English as a seeond 
language, adult noneredit instruetion, and providing support serviees that help students to sueeeed. 
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The proposed model attempts to encompass these fundamentals in structure and 
substance. 



Sources of Data. There are three major sources of data for performance models for the 
California community colleges. They are: 

1 . Community college data contained in the Management Information System (MIS) 
at the State Chancellor’s Office; 

2. Community college performance data located at the districts; 

3. New data generated from research studies and surveys mandated and funded by 
the state, or new data generated and paid for by districts as a result of a district 
level decision. 

The proposal attempts to maximize the usage of existing data sources where applicable so 
as to minimize institutional burden on collecting new data. 
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The Proposal: A Performance Framework for the California Community 

Colleges 



The Board of Governors of the California Community Colleges reeommend the 
framework deseribed below for distriet-speeilio reporting of priority edueational outeome 
measures. This reeommended framework would provide valuable information not only 
to state policymakers, but also to local community college districts, which over time 
could contribute toward improved instruction and related programs for students. This 
framework, if approved through legislation and funded through the annual budget act, 
would result in an annual report to the Legislature and the Governor that would include 
the elements described below. 



Performance Categories: What Areas to Measure 

Four performance categories are identified: 

1 . Student Progress and Achievement: Degree/Certificate/Transfer. Performance 
metrics in this category attempt to isolate and measure student achievement 
for students who show behavioral intent to earn an AA/AS/certificate or 
transfer to a four-year institution. 

2. Student Progress and Achievement: Vocational/Occupational/Workforce 
Development. Performance metrics in this category show success and 
outcomes for students in vocational/occupational/workforce development 
courses and programs. 

3. Pre-collegiate Improvement (Basic Skills and ESL). Performance metrics in 
this category show success and progress in basic skills and English as a 
Second Language (ESL) curricular activities. 

4. Participation. Performance metrics in this category portray student 
participation as defined by participation rates in the system as compared to the 
State’s adult population. 

Other areas of community college missions were discussed, including fiscal health and 
noncredit curriculum and programs, but were not included as they were either not 
applicable to the AB1417 mandate or were already reported in some other venue. 



Performance Framework: How To Report 

The panel is recommending two levels of aggregation for the performance framework: 

1 . District Core Indicators. Each District Core indicator would be aggregated and 
reported on at the District level. The System Office would provide the data and 
calculate the report for core performance indicators across each of the state- 
established performance categories. 

2. System Indicators. System performance metrics within the four performance 
categories would be aggregated at the statewide level (with possibly demographic 
breakdowns for the State as a whole). The System Office would calculate and 
perform the system indicators. 
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Note that system indieator metrics are not simple statewide aggregations of district core 
indicators; the set of district core indicator metrics are different than the set of system 
indicator metrics. Some system indicator metrics are unable to be broken down at a 
district level, are nonsensical to be evaluated on a district level, or violate the “fair and 
equitable” caveat of the framework. System indicators, however, do represent in many 
cases well-established performance metrics that show system progress or help 
policymakers evaluate changing environments and the effects of policy decisions that 
affect performance. 



Performance Metrics: What to Report 

Please refer to the “Draft Proposed Metrics” section of this document (Appendix D) to 
see the exact draft set of proposed metrics. 



District Profiie 

It is proposed that before reporting the draft metrics, each district report will feature a 
“district profile”, which would include background and explanatory information about 
the district and who it serves. This would include, but not be limited to: 

• Description of the population served by the district (breakdowns of students by 
race, gender, age, citizenship, and other student descriptors) 

• Description of any special limitations confronting the district that may inhibit 
institutional capacity to deliver educational services 

• Description of key ratios (student to counselor, full-time faculty to part-time 
faculty) 

• Historical funding and FTES (full time equivalent students) 



District Anaiysis and Response 

We propose that Districts have a review period of annual draft reporting that would 
enable them to provide an analysis statement of the performance metrics that will be 
included in the final annual report. 



Other impiementation issues 

The following are recommendations regarding implementation of the reporting 
framework. 

• Do not codify exact metrics into law or budget language. This locks both the 
system and the State into an inflexible situation in the future should priorities 
change. 
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• Allow for continual examination of model efficacy. The reporting framework and 
associated metrics should have the flexibility to be modified in future iterations to 
capture new data sources, new measurements, or to eliminate metrics that show 
inadequate validity in measuring what the system and State desire. Changes to 
the model and its metrics should be an option discussed annually by all involved 
parties, which, at a minimum, should include the Chancellor’s Office, the 
Department of Finance, and the Legislative Analyst’s Office. 

• Allow for 60-day review period by districts. Districts should be allowed a review 
period of at least 60 days to examine annual data to ensure its accuracy and 
respond. Should data seem inaccurate, this time frame should be sufficient to 
resubmit MIS data and have it recalculated for final submission. 

• Allow for funding tie-in with data submission/review requirement. It is important 
that cooperation of the districts occur with the submission of data necessary for 
the timely reporting of the proposed framework. It is equally important that 
districts annualy review their performance figures for self-assessment. It is 
proposed that districts would ensure timely and proper data submission and 
review the annual report, or the possibility would exist that local assistance 
funding could be withheld from them. 

• System Office resources will need to be addressed. Although we have done our 
best in the design of this reporting framework to minimize the creation of a large 
reporting bureaucracy, the existing staffing levels in the Technology, Research, 
and Information Systems Division are not adequate to implement the framework. 
Moreover, because recent severe budget cuts have reduced overall staffing in the 
Chancellor’s Office (from 215 positions in 2001-02 to 144 today — a 33 percent 
decline), the ability of the Chancellor’s Office to redirect staff to accomplish 
additional workload is effectively exhausted. We estimate that an augmentation 
of about $400,000 and four additional positions would be needed for the 
Chancellor’s Office to implement the proposed framework. This would allow for 
the creation of the annual report only; this estimate does not include any costs 
associated with subsequent compliance monitoring or technical assistance. 



Performance Evaluation 

It is the recommendation of the RP/CSS Review Panel (with the endorsement of 
members of the External Panel of Experts and the Oversight Committee) that the State of 
California utilize the existing district and state level infrastructure for performance 
evaluation within the AB 1417 System. This is a system of “value-added” self assessment 
that looks at the array of performance metrics and evaluates a district’s most current 
performance against that district’s past performance. Such evaluation could include 
comparisons of current performance to prior year performance, a three-year running 
performance, or performance against a baseline year for that district. District performance 
should not be made directly against the performance of other districts nor should it be 
made against artificially generated pre-defined standards due to inherent 
incomparabilities and exogenous factors that affect district performance. 
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However, the annual reporting is proposed to inelude some comparitive peer-grouping 
information that will enable local districts and policymakers to view district performance 
against various peer groupings (such as districts with similar size, similar distance to 
transfer partners, similar levels of student academic preparedness upon entry, etc.). 

Triggers to in-depth evaluation should be continual declines in outcomes over a period of 
time that are outside the band of normal annual fluctuations; for instance, a continual 
three-year decline in performance in a metric (where a statewide average over the same 
time period is not also in decline) might warrant a review or other possible intervention to 
help assess how the decline could be affected or rectified. The most important outcome of 
the evaluation should be local engagement in assessing why performance is in decline 
over a longer period of time, and in the creation of local mitigating interventions. 
Regardless of a district’s relative performance against other districts, a decline of 
performance metrics over time should be a warning flag that causes local analysis and 
intervention. 

After a few years of implementation, the districts and the System Office will have a better 
understanding of the performance measures and how well performance evaluation is 
functioning. This review should include an evaluation of the effectiveness of the actual 
measures themselves in terms of whether they provide districts with good information for 
institutional improvement on behalf of their students. 

The possible levels of review and intervention and technical assistance are subject to the 
level of resources the State wishes to devote to these activities. Additional actions or 
activities undertaken by the System Office beyond producing the annual performace 
report will also require augmentation of resources, and the State needs to consider the 
cost-benefit of such actions so as not to create an inefficient reporting/compliance 
monitoring beareaucracy. The System Office, along with the Department of Finance and 
the Legislative Analyst’s Office will be discussing these options should implementation 
of this proposed framework occur. 



Conclusions 

This report provides the Legislature and Governor, as specified by AB1417, with 
recommendations for “...the design of a workable structure for the annual evaluation of 
district-level performance in meeting statewide educational priorities...” We believe 
these recommendations are well-tailored to the uniquely varied educational needs and 
missions of the California Community Colleges. The recommended framework would 
provide valuable information not only to state policymakers, but also to local community 
college districts, which over time could contribute toward improved instruction and 
related programs for students. Implementation of this framework would require the 
enactment of authorizing legislation and a relatively modest augmentation of resources 
for the Chancellor’s Office. 
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Appendix A 



Member Profiles 

Research and Planning Group/Center for Student Success 
Panel for California Community College Performance Framework Study 



Dr. Judith A. Beachler \s Director of Institutional Research at Los Rios Community College District. Her 
background includes a Ph.D. in Public and International Affairs (University of Pittsburgh, PA), with a minor in 
Higher Education Policy and research experience on the relationship between higher education and 
economic development, in addition to 16-years of experience in community college management, 
institutional research and planning. Judy was also a former member of the RP Group Board. 

Dr. Robert Gabriner ls the Director of the Center for Student Success of the Research and Planning Group. 
He is also a former President of the RP Group and editor of the RP ijournal. He is Dean of Research, 
Planning and Grants of City College of San Francisco. He has a doctorate in educational policy and a 
masters degree in history. Formerly a history instructor for twenty years in the Peralta Colleges in Oakland, 
California. Dr. Gabriner is one of the architects of the Community College Reform Act of California (AB 
1725 ). 

Dr. Craig Hayward is the Director of Institutional Research for the Mendocino-Lake Community College 
District. His educational background includes a Bachelor’s degree in Journalism from Boston University and 
a doctorate in Human Development from the University of California, Irvine. He has taught psychology, 
research methods and statistics for all three public systems of higher education in California. He is currently 
Vice President of the California Association of Institutional Research and a member of the RP group. 

Dr. Kenneth Meehan is Director of Institutional Research at Fullerton College and President-Elect of the 
Research and Planning Group for California Community Colleges. He is the former editor of the RP 
eJournal of Research, Planning and Practice. He has served as the Southwest Regional Director of the 
National Council for Research and Planning. He has consulted with the National Center for Educational 
Statistics and served as the statewide IPEDS trainer for California. He also served on the National Joint 
Commission on Accountability Reporting, statewide Transfer Data Technical Workgroup and currently sits 
on the Advisory Committee for the National Study of Community College Instructional Costs and 
Productivity and provides research consultation to statewide Algebra Pathways Project. Dr. Meehan has 
authored several hundred professional publications and presentations. 

Dr. Brad C. Phiiiips is the founder and Executive Director of the California Partnership for Achieving 
Student Success (Cal-PASS) project; a statewide initiative to gather and track student outcomes from K-16 
institutions. His background includes a Doctorate in Applied Social Psychology from Claremont Graduate 
University. He recently transitioned from Senior Director of Institutional Research, Planning, and Academic 
Services at the Grossmont-Cuyamaca Community College District, located in El Cajon, California, part of 
San Diego County. He has co-authored articles on data sharing that have been published in Community 
College Journal, Journal of Applied Research in the Community Colleges and Community College Times. 

Dr. Andreea M. Serban is Associate VP for Information Resources and Director of Inst. Assessment, 
Research and Planning at Santa Barbara City College. She is the RP President, Chair of the AIR 
Publications Committee and Associate Editor of SCUP’s journal * Planning for Higher Education. Dr. Serban 
is author of three books and many articles. She has written extensively and made presentations on 
accountability, and performance reporting, funding and indicators. 
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Member Profiles 
State Chancellor’s Office Team 



Patrick Perry is Vice Chancellor in charge of Research, Planning, Technology and Telecommunications 
and MIS Services at the State Chancellor’s Office of the California Community College system. He has 
served in the State Chancellor’s Office for six years. 

Willard Horn is Director, Research & Planning Unit, at the State Chancellor’s Office of the California 
Community Colleges. His background includes more than twenty years of research in the areas of health 
services, employment/labor, and community colleges. 
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Appendix B 



Member Profiles 

External Panel for California Community College Performance Framework Study 



Dr. Trudy Bars is Senior Director of Research, Curriculum and Planning and Executive Assistant to the 
President (both roles at Oakton CC, Des Plaines, IL). Her background includes a doctorate in political 
science (University of Illinois-Urbana) and service as 1995-6 president of the Association for Institutional 
Research and president of the National Council for Research and Planning. 

Dr. Joseph Burke is Director of the Rockefeller Institute’s Higher Education Program (State University of 
New York). His background as a teacher, administrator, and researcher includes service as President (12 
years at SUNY College at Plattsburgh), Provost (9 years with the SUNY system), and various publications 
covering topics that include performance indicators/funding in community college systems, system 
governance, and academic outcomes assessment. Burke edited the recent publication Achieving 
Accountabiiity in Higher Education: Baiancing Pubiic, Academic, and Market Demands (Jossey-Bass: 
October 2004). 

Dr. Peter Ewell is Vice President of the National Center for Higher Education Management Systems 
(NCHEMS, Boulder, CO). His background includes a doctorate in political science (Yale) and work as 
Coordinator for Long-Range Planning (Governors State University), a faculty member (University of 
Chicago), and author (six books on improving undergraduate instruction). 

Dr. Andrew M. Gill is professor of economics at California State University Fullerton (with emphasis in labor 
economics and econometrics). His background includes a doctorate in economics (Washington State 
University) and extensive research in human resource topics, including the role of community colleges in the 
economy. He recently co-authored (with Dr. Duane E. Leigh) Evaluating Academic Programs in California’s 
Community Colleges, a monograph published in 2004 by the Public Policy Institute of California. 

Dr. James Jacobs is the Associate Director for Community College Operations at the Community College 
Research Center (Columbia University) and the Director of the Center for Workforce Development at 
Macomb Community College Warren, Michigan. His background includes extensive analysis in the area of 
community college-based workforce development and service. He is currently the President of the National 
Council of Workforce Education (AACC). 
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Appendix C 



Member Profiles 

Chancellor’s AB1417 Oversight Committee 



Kate Clark is the President of the statewide Academic Senate. Before her tenure as president, she served 
as vice-president of the state Academic Senate. She teaches English at Irvine Valley College. 

Nick! Harrington is the Superintendent/President of Yuba College and a member of the CEO Board, 
Community College League of California. 

Brice Harris is the Chancellor of the Los Rios Community College District and President of the CEO Board 
for 2004/5. 

Jane Patton is the division chair in the Communication Studies Department at Mission College. She has 
taught at Mission College since 1986. 

Diane Woodruff is the Director, Strategic Initiatives, for the Community College League of California 
(CCLC). Before joining the CCLC in 2002, she served as Superintendent/President of Napa Valley College. 
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Appendix D 



AB1417 PERFORMANCE REPORTING PROJECT: PROPOSED METRICS 



• District Core Indicators - required and reported for all districts, calculated by the Chancellor’s Office 

• System Indicators - reported on a system wide aggregate basis only; calculated by the Chancellor’s Office 



CATEGORY 


NUMBER OF 
DISTRICT CORE 
INDICATORS 


NUMBER OF 
SYSTEM 
INDICATORS 


TOTAL NUMBER 
OF SYSTEM AND 
CORE 

INDICATORS 


Student Progress and 
Achievement: Degree / 
Certificate / Transfer 


2 


3 


5 


Student Progress and 
Achievement: Vocational / 
Occupational / Workforce 
Development 


1 


2 


3 


Pre-collegiate 

Improvement/Basic 

Skills/ESL 


3 


1 


4 


Participation 


0 


1 


1 


TOTAL 


6 


7 


13 























Indicator Name Definition Data Source Comments 



STUDENT PROGRESS AND ACHIEVEMENT: DegreelCertificatelTransfer 



District Core indicators (reporting will be for all Districts; calculated by System Office) 


student Achievement and 
Progress Rate (for “Cohort A” 
students) 


Percentage of cohort of first-time students with minimum of 12 units earned 
who attempt degree/certificate/transfer threshoid course within 6 years of entry 
(“Cohort A”) who are shown to have achieved ANY of the foiiowing outcomes 
or vaiue-added measures of progress within 6 years of entry: 

• Earned any AA/AS or Certificate 

• actuai transfer to a four-year institution (student shown to have 
enroiied at any four-year institution of higher education after 
enroiiing at a CCC) 

• achieved “Transfer Directed” (student successfuiiy compieted both 
transfer-ievei Math AND Engiish courses) 

• achieved “Transfer Prepared” (student successfuiiy compieted 60 
UC/CSU transferabie units with a GPA >=2.0 in those transferabie 
courses) 


System Office 
MIS 


Uses “Cohort A” as denominator. 

“Cohort A” attempts to measure students who have crossed 
the same threshoid equaiiy at each District, regardiess of 
institutionai mission or size. 

The indicator measures what percentage of the cohort 
achieves any type of the aforementioned measures of 
success or progress. 




and/or 








• earned at ieast 30 units whiie in the CCC system (vaiue-added 
threshoid of units earned as defined in wage studies as having a 
positive affect on future earnings) 




It is proposed that the “earned 30 units” portion of this rate 
be examined at impiementation and possibiy reported 
separateiy. 


Persistence Rate of “Cohort A” 
students, first year to second 
year 


Percentage of cohort of first-time students with minimum of 12 units earned 
who attempt degree/certificate/transfer threshoid course within 6 years of entry 
who return and enroii at any time in their second year anywhere in the system. 


System Office 
MIS 


Uses “Cohort A” as denominator. 

Standard year-to-year persistence rate caicuiation for 
outcomes-oriented students. 


System indicators (reporting will be at a Statewide aggregate level; calculated by System Office) 


Annuai Voiume of Transfers to 
Four-year institutions 


Voiume of most current fuii-year transfer counts from CCC to other four-year 
institutions of higher education. 


Receiving 
institutions; 
possibie data 
match 


Commoniy used transfer voiume metric; shows how State 
and receiving institution admittance poiicies affect current 
year transfers between segments. Not usefui to measure at 
a district ievei because of voiume incomparabiiity between 
districts. 


Transfer Rate to Four year 
institutions for Community 
Coiiege system 


Transfer rate based on first-time freshman cohort anaiysis of student 
behaviorai intent to transfer. 


System Office 


System ievei transfer rate, to be broken out by segment of 
transfer destination and student demographic. Based on 
current transfer rate methodoiogy. 


Annuai Percentage of 
Baccaiaureate students 
graduating UC and CSU who 
attended a community coiiege 


Percentage of aii graduating students from any CSU or UC campus that has 
enroiied in one or more of the community coiieges prior to graduation. 


System Office 


This system metric wiii provide the state with a fuii picture of 
the extent to which baccaiaureates students utiiize the 
Caiifornia community coiieges to achieve their 
baccaiaureate educationai goais. 







Indicator Name 


Definition 


Data 


Comments 






Source 





STUDENT PROGRESS & ACHIEVEMENT: VocationallOccupationallWorkforce Development 



District Core indicators (reporting will be for all Districts; calculated by System Office) 


Annual Successful Course 
Completion Rate 
(VOCATIONAL COURSES) 


Most recent annual rate of successful course completion In 
VOCATIONAL courses. Successful Is defined as having been 
retained to end of term with a final course grade of A, B, C, or 
CR. SAM A, B and C ONLY. 


System 
Office MIS 


Specifically for Vocational Courses, as these are a priority area for the State. 


System indicators (reporting will be at a Statewide aggregate level; calculated by System Office) 


Annual Volume of 
Degrees/Certificates conferred 
by Program 


Volume of most current full year of AA/AS/CertIfIcates 
conferred, broken down by degree type and program (major 
TOP code). 


System 
Office MIS 


Commonly used degree/certificate volume metric; shows annual system production 
of award recipients by program subject area (nursing, accounting, auto mechanics, 
etc.) Not useful to measure at a district level because of volume Incomparablllty 
between districts; not all districts offer all types of programs. 


Increase In total personal 
Income as a result of receiving 
degree/certificate 


Statewide Increase of median personal Income of 
AA/AS/CertIfIcate students taken at some point after award 
conferral. Students shown to be still enrolled will be taken out 
of the calculation. 


System 
Office MIS 


System level degree and certificate attainment rate. Methodology of devising 
“behavioral Intent to earn degree/certificate” would need to be developed. 







Indicator Name 


Definition 


Data 

Source 


Comments 


PRE-COLLEGIATE IMPROVEMENT - BASIC SKILLS - ESL 



District Core indicators (reporting will be for all Districts; calculated by System Office) 


Annual Successful 
Course Completion Rate 
(Basic Skills Courses) 


Most recent annual rate of successful course completion In Basic Skills courses. Successful Is defined as 
having been retained to end of term with a final course grade of A, B, C, or CR. 


System 
Office MIS 


Specifically for Basic Skills Courses, as these 
are a priority area for the State. Evaluation 
Issues are similar to other Successful Course 
Completion rates shown above. 


ESL Improvement Rate 


Percent of students who attempted/completed at least one credit ESL course In a term who 
attempted/completed a higher level ESL course or a college level course within two years of taking the 
ESL course (a two-year cohort examination). The various combination of attempted-attempted, completed- 
attempted, or completed-completed will be determined at a alter date. Only students starting at 2 or more 
levels below college level/transfer level will be counted. 


System 
Office MIS 


Shows progress through basic skills 
curriculum. Districts without ESL programs 
would be waived from this Indicator. 


Basic Skills Improvement 
Rate 


Percent of students who attempted/completed at least one credit basic skills course In a term who 
attempted/completed a higher level basic skills course In the same discipline (reading, writing, math, 
respectively) or a college level course within two years of taking the first basic skills course (a two-year 
cohort examination). The various combination of attempted-attempted, completed-attempted, or 
completed-completed will be determined at a alter date. Only students starting at 2 or more levels below 
college level/transfer level will be counted. 


System 
Office MIS 


Shows progress through basic skills 
curriculum. 


System indicators (reporting will be at a Statewide aggregate level; derived by System Office 


Annual Volume of basic 
skills Improvements 


The annual volume of students completing coursework at least one level above their prior basic skills 
enrollment. 


System 
Office MIS 


Same methodology as PFE Metric #5. 







Indicator Name 


Definition 


Data 


Comments 






Source 





PARTICIPATION 



District Core indicators (reporting will be for all Districts; calculated by System Office) 



None. 



System indicators (reporting will be at a Statewide aggregate level; calculated by System Office 


statewide Participation 
Rate (by seiected 
demographics) 


Statewide aggregated participation rates by various demographic eiements, 
inciuding ethnicity, age group, and gender. Participation rates determined by 
undupiicated annuai headcount attending divided by aduit popuiation (18- 
65) in Caiifornia, as per census and DOF estimates. 


System Office 
MIS; census; 
DOF 


Measures what percentage of students (by demographic) attends CCC's 
statewide. This metric is best measured at a statewide ievei due to 
inabiiity to centraiiy define district/service area boundaries and because 
of students attending across district boundaries. 







